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3D-INPUT DEVICE AND METHOD, SOFT KEY MAPPING METHOD THEREFOR. 
AND VIRTUAL KEYBOARD CONSTRUCTED USING THE SOFT KEY MAPPING 

METHOD 

BACKGROUND OF THE INVENTION 

[01] This application is based upon and claims the benefit of priority from Korean 

Patent Application No. 2003-25715, filed on April 23, 2003, in the Korean Intellectual Property 
Office, the disclosure of which is incorporated herein in its entirety by reference. 

1. Field of the Invention 

[02] The present invention relates to a three-dimensional (3D)-input device and 

method, a soft key mapping method therefore, and a virtual keyboard constructed using the 
mapping method, and more particularly, to a 3D-input device and method, a soft key mapping 
method therefore, and a virtual keyboard for efficiently inputting data to a device in a wearable 
or mobile computing environment. 

2. Description of the Related Art 

[03] Recently, information input devices that are worn on the hand for inputting 

information spatially in a wearable or mobile computing environment are being developed. 
Examples of such information input devices include clickure sensor gloves, finger rings that 
sense movements of the fingers using optical fibers, and air gloves. These data input devices are 
based on a virtual QWERTY keyboard like that shown in FIG. 1. In a QWERTY keyboard, 
which is the current standard keyboard, one bit corresponds to one button and one character 
corresponds to the one bit. 
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[04] In the virtual QWERTY keyboard, input information is determined by 

discriminating a movement of a hand from movements of the fingers, but there are the following 
problems. First, precise movements of the hand and the fingers are required. Namely, a user is 
required to learn exact finger positions on the keyboard. It is difficult because the QWERTY 
keyboard has many keys to be displayed and the input device adopting an inertial sensor is 
sensitive to movements of the hands and fingers. Thus, in using the virtual QWERTY keyboard, 
an error rate for a click motion is low, but an error rate for selecting information through 
movement of the hands and fingers is high. 

[05] Second, a key may be duplicably mapped to each different finger, as shown in 

FIGS. 2A through 2C. For example, when a key is input through 3 fingers, the "h" can be input 
using a right side finger in a case of FIG. 2 A, using the middle finger in a case of FIG. 2B, and 
using the left side finger in a case of FIG. 2C according to a hand position. Here, since there are 
three possibilities for inputting one key, the speed of inputting information is lowered and the 
difficultly of learning the keyboard is increased. Also, since a key can be input by using 
different fingers, not using a single fixed finger, there exist problems that the fingers are used 
inefficiently in view of function and key combination is not necessary. Therefore, it is necessary 
to improve a conventional information input scheme, which maps a single character to a single 
key and has the corresponding key to be clicked to input information. 

SUMMARY OF THE INVENTION 

[06] The invention provides a 3D-input device and method, a soft key mapping 

method therefor, and a virtual keyboard constructed using the mapping method, by which a 
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plurality of characters are mapped onto each key and input information is determined by 
distinguishing a sequence of fingers clicking the key. 

[07] According to an aspect of the present invention, there is provided a 3D-input 

device for inputting information using a virtual keyboard including: a hand position and finger 
order determination unit that determines: a selected button, of a plurality of buttons of the virtual 
keyboard, that is selected by a user; and an order of the user's fingers used to select the selected 
button; a key information storage unit that stores key values respectively mapped to both a 
predefined button of the plurality of buttons of the virtual keyboard and a predefined order of the 
user's fingers used to select the predefined button; and a key determination unit that finds a 
selected key value by matching the selected button and order of the user's fingers with the 
predefined button and predefined order of the user's fingers mapped in the key information 
storage unit 

[08] According to another aspect of the present invention, there is provided a 3D-input 

method for inputting information using a virtual keyboard including: sensing the selection of a 
virtual button of the virtual keyboard by a user; sensing positions of the user's fingers relative to 
the virtual button, and the order of the user's fingers that are used to select the virtual button; and 
identifying a selected key value corresponding to the sensed positions of the fingers and the 
order of the user's fingers that are used to select the virtual button, amongst a plurality of stored 
key values 

[09] According to another aspect of the present invention, there is provided a soft key 

mapping method for mapping keys onto virtual buttons of a virtual keyboard that are selected by 
a user's fingers upon which are individually mounted a plurality of sensors, the method 
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comprising: determining the number of sensors; allocating key values according to the number of 
sensors; mapping the allocated key values onto a first virtual button; and repeating the 
determining, allocating and mapping for the remaining virtual buttons. 

[10] According to another aspect of the present invention, there is provided a virtual 

keyboard comprising a plurality of virtual buttons selectable by a user's fingers upon which are 
mounted a plurality of sensors, the virtual keyboard constructed by mapping key valufes onto 
each of the virtual buttons and arranging the virtual buttons according to a predetermined 
condition using a method comprising: determining the number of sensors; allocating key values 
to the number of sensors; mapping the allocated key values onto a first virtual button; and 
repeating the determining, allocating and mapping for the remaining virtual buttons. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[11] The above and other features and advantages of the present invention will become 

more apparent by describing in detail exemplary embodiments thereof with reference to the 
attached drawings in which: 

[12] FIG. 1 is a view of a conventional QWERTY keyboard; 

[13] FIGS. 2 A through 2C show selection of the same key using different fingers in a 

conventional virtual keyboard; 

[14] FIG. 3 is a block diagram of an exemplary 3D-input device according to the 

invention; 

[15] FIG. 4 shows examples of cases according to clicks performed by each finger 

when using 3 fingers and key values allocated to a single button thereby; 
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[16] FIG. 5 shows examples of cases according to clicks performed by each finger 

when using 2 fingers and key values allocated to a single button thereby; and 
[17] FIGS. 6 A through 6D show examples of various key values of buttons that may 

be mapped when a plurality of fingers are used. 

DETAILED DESCRIPTION OF THE INVENTION 

[18] Exemplary embodiments of the invention will now be described below by 

reference to the attached Figures. The described exemplary embodiments are intended to assist 
the understanding of the invention, and are not intended to limit the scope of the invention in any 
way. 

[19] FIG. 3 is a block diagram of a three-dimensional (3D)-input device according to 

the present invention. The 3D-input device of FIG. 3 comprises a sensing device 30, a signal 
processing unit 32, a hand position and finger order determination unit 34, a key information 
storage unit 36, and a key determination unit 38. The 3D-input device is based on a virtual 
keyboard, and, herein, a button means a soft key button. 

[20] The sensing device 30 comprises a plurality of sensors 30-1, 30-2, and 30-3 which 

can be mounted or worn on respective fingers. Alternatively, the sensing device 30 may be 
formed as a glove on which sensors are disposed on appropriate portions of fingers. The sensors 
30-1, 30-2, and 30-3 sense the movement of their respective fingers to output a signal for 
inputting or selecting information. Any kind of sensors that are capable of sensing finger 
movement can be used as the sensors 30-1, 30-2 and 30. Examples of these sensors include: 
sensors that output a digital signal, such as inertial sensors; sensors that output an analog signal, 
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such as potentiometers; giant magnetoresistive (GMR) sensors; optical sensors; on/off switches; 
and clickure sensors. 

[21] The signal processing unit 32 receives and processes the signal output from the 

sensors 30-1, 30-2, and 30-3 in a wired or wireless way, to recognize the positions of the 
respective sensors 30-1, 30-2, and 30-3 and to extract information on movement of the fingers. 
[22] The hand position and finger order determination unit 34 determines a' hand 

position and which finger among the sensor mounted fingers is used to click a button, based on 
information indicating sensor positions and finger movements extracted by the signal processing 
unit 32. 

[23] The key information storage unit 36 stores a key value that corresponds to which 

finger or fingers are used to click the button. 

[24] The key determination unit 38 determines a key value corresponding to the 

presently clicked button with reference to the key values stored in the key information storage 
unit 36, and inputs the key value to an object device (not shown). The key values stored in the 
key information storage unit 36 are now described. A key value is determined according to an 
order of fingers clicking the button, namely, which one of the fingers in order is used to click the 
button. In the case of using n fingers, there are (2n-l) cases according to an order of the n 
fingers that can be used to click keys and keys can be allocated to each case that is designated by 
a user. 

[25] FIG. 4 shows examples of cases according to clicks performed by each finger 

when using 3 fingers and key values allocated to a single button thereby. Specifically, FIG. 4(a) 
shows cases when clicks are performed by each one of the 3 fingers, FIG. 4(b) shows a case of 
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three characters mapped onto a button 40, FIG. 4(c) shows a case of five characters mapped onto 
a button 41, and FIG. 4(d) shows a case of six characters mapped onto a key 42. In the case 
shown in FIG. 4(b), the key value can be mapped as C when the button 40 is clicked using only 
the third finger, B when the button 40 is clicked using only the second finger, and A when the 
button 40 is clicked using only the first finger. Subsequently, the 3 characters can be mapped 
onto the single button 40. In the case shown in FIG. 4(c), besides the key values mapped in the 
case shown in FIG. 4(b), two more characters can be mapped by clicking the button 41 
substantially simultaneously using two fingers. For example, D when the button 41 is clicked 
substantially simultaneously using the second and third fingers, and E when the button 41 is 
clicked substantially simultaneously using the first and second fingers. The case shown in FIG. 
4(d) is the same as the case of FIG. 4(c), except that the key value F is further mapped to the 
button 42, corresponding to when the button 42 is clicked substantially simultaneously using the 
first and third fingers. Although not shown in FIG. 4, a seventh character, G, could be mapped 
onto the button 42, corresponding to clicking the button 42 substantially simultaneously using all 
three fingers. Subsequently, all 7 characters can be mapped onto the single button 42. 
[26] FIG. 5 shows examples of cases according to clicks performed by each finger 

when using 2 fingers and key values allocated to a single button thereby. Specifically, FIG. 5(a) 
shows cases when clicks are performed by each one of the 2 fingers, FIG. 5(b) shows a case of 
two characters mapped onto a button 50, and FIG. 5(c) shows a case of three characters mapped 
onto a button 51. In the case shown in FIG. 5(b), the key value is B when the button 50 is 
clicked using only the second finger, and A when the button 50 is clicked using only the first 
finger. Subsequently, the 2 characters can be mapped onto the single button 50. In the case 
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shown in FIG. 5(c), besides the key values mapped in the case shown in FIG. 5(b), C can be 
additionally mapped onto the button 51 by clicking the button 51 substantially simultaneously 
using the first and second fingers. 

[27] FIGS. 6 A through 6D show examples of various key values of buttons that may 

be mapped when a plurality of fingers are used. FIG. 6A shows a case in which every three (3) 
characters in the same order as the ones on the QWERTY keyboard are mapped onto" each button. 
FIG. 6B shows a case in which every three (3) English characters are mapped onto each button in 
alphabetical order. FIG. 6C shows a case in which Korean vowels and consonants, and other 
symbols, are mapped onto nine buttons. Here, the Korean vowels and consonants only require 
six buttons. The remaining three (3) buttons can be mapped as defined by a user. FIG. 6D ° 
shows a case which can be realized as a case of using both hands. As shown in FIG. 6D, special 
characters or frequently used characters can be double mapped to more than one button for the 
sake of convenience. These key mappings may be performed according to frequencies of the 
uses of characters, digits or special characters. 

[28] According to the present invention, a plurality of characters can be mapped onto 

one button by distinguishing an order of fingers clicking the button. Thus, the number of buttons 
required to represent a given number of characters can be reduced, making more efficient use of 
space, typing speed can be increased by enhancing key combinations, and minimizing 
dependence on sensor movements. 

[29] A method for discriminating key values according to an order of fingers clicking a 

button is described as an embodiment of the invention, when the button is clicked by two (2) or 
three (3) fingers. The number of characters mapped onto each button or an order of characters 
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arrangement may be varied according to the number of fingers used to click a button or a click 
frequency of a button. 

[30] While the invention has been particularly shown and described with reference to 

exemplary embodiments thereof, the invention is not limited to these embodiments. It will be 
understood by those of ordinary skill in the art that various changes in form and details may be 
made therein without departing from the spirit and scope of the present invention as defined by 
the following claims. 
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